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Abstract. Simple stochastic exchange games are based on random allocation of finite resources. These 
games are Markov chains that can be studied either analytically or by Monte Carlo simulations. In partic- 
ular, the equilibrium distribution can be derived either by direct diagonalization of the transition matrix, 
or using the detailed balance equation, or by Monte Carlo estimates. In this paper, these methods are 
introduced and applied to the Bennati-Dragulescu-Yakovenko (BDY) game. The exact analysis shows that 
the statistical-mechanical analogies used in the previous literature have to be revised. 

PACS. 89.65.Gh Economics; econophysics, financial markets, business and management - 02.50.Cw Prob- 
ability theory 

1 Introduction Each agent i is characterized by a certain quantity rii, 

which represents either size, or wealth or another relevant 
Agent-based models used for simulating the allocation of quantity. The interactions determine a variation of as 
finite resources in economics include g agents that can a function of time. In the models, the evolution of the 
interact. These interactions can be direct and can include system can be described both in continuous time and in 
both two-body and many-body terms, but they can also be discrete time. In this framework, it is worth mentioning 
indirect, through some coupling and feedback mechanism the so-called Interacting Particle Systems paradigm that 
with an external field. 
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includes, as special cases, percolation, the Ising model, the coin toss, the winner receives a fixed amount of money, d. 
voter model, and the contact model pp. Indebtedness is impossible: Players reaching n.j = can- 
In general, these models are Markov chains or conti- not lose money any more. If they are selected to play and 
nuous-time Markov processes. Therefore, there is a full they lose, they stay with no money, if they win, they get 
set of mathematical tools to analyze them and compute the fixed amount of money from the loser. On the con- 
the equilibrium distribution. In this paper, however, the trary, in the OPIP, very poor agents always lose only a 
focus is on conservative models, where the total number fraction of their money, and they never reach the situa- 
of agents, g, and the total size or wealth, n = Y^i=i n i-> tion n i = 0. In the OPIP, the variables rii are intrinsically 
are conserved by the dynamics. continuous, whereas in the BDY model they can be con- 
John Angle has introduced the so-called One Parame- sidcrcd discrete. 



ter Inequality Process (OPIP) that can be defined as fol- 
lows. Let us suppose that there are g players in a room, 
each of them with an initial amount of money, rii(0) = 

n/g. Two individuals are randomly selected to play against 

. . „ „. . , . „ . step two agents are chosen, and they toss a coin. At the 

each other. I hey flip a com and the winner gets a fixed 



To summarize, the BDY game can be described as 
follows. Let us consider a system of g > 1 individuals 
(agents) who share n coins, n > g. At each discrete time 



end of the bet, the winner has one more coin and the loser 
has one coin less (d = 1 is assumed, without loss of gener- 
ality). Agents' choice is random (i.e. each distinct couple 
has the same probability to be extracted) and each bet is 
fair. If the loser has no coins, then the move is forbidden 
and and a new couple of players is extracted. An equivalent 



fraction, u>, of the loser's money. Then the game is iter- 
ated. If j and k are the selected players at step t, their 
amount of money at step t + 1 is given by: 

n.j(t + l) = rij(t) + cud(t + l)n k {t) - u(l - d(t + l))rij(t), 



n k (t + 1) = n k (t) - Lud(t + l)n k {t) + w(l - d(t + !))%(*), 



formulation of the game, avoiding forbidden moves, is the 
following. An agent is chosen randomly among all those 
having at least one coin, and this agent is declared to be 
the loser; the winner is chosen randomly among all agents. 



where d(t) is a Bernoullian random variable assuming the 
value 1 with probability 1 /2 or the value with probability 
1/2. Angle has studied the equilibrium distribution for the 

OPIP by means of Monte Carlo simulations and analytical This paper will be devoted to an analysis of the BDY 
approximations game. In section II, the basic random variables for the 

The Bennati-Dragulescu-Yakovenko (BDY) model de- description of the game will be introduced. Section III 
scribed in and rediscovered in [7| is very similar to will be devoted to the methods of solution and it is the 
the OPIP, but there is an important difference. After the core section of this paper. Finally, in section IV a critical 
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discussion of the results will be presented. The reader will (not the names or labels) of agents with h coins. This 
find further mathematical details in an appendix. is the frequency distribution of agents, commonly referred 

to as wealth distribution; it is an event, not to be confused 
2 Random Variables with a probability distribution. The constraints for Z arc 



Zi — g, izi — n. For the BDY game, the number 
of agents without money, zq , is very important. Its com- 
plement is k — g — zq , the number of agents with at least 



one com. 



In the BDY game, as well as in similar exchange games, 
one has to allocate n coins among g agents. In the follow- 
ing, a random variable will be denoted by a capital letter: 
A, whereas a will refer to a specific value or realization. 

The most complete description of the game states is 
in terms of coin configurations: X = (X±, . . . , X n ). Each 
random variable Xi is associated to the ith— coin, and its 
range is the set of agents; for instance, X 7 = 3 denotes 

that the 7th— coin belongs to the 3rd— agent. The total 

, .. „ ,. r . ,. , ; i ping of a coin from one agent (the loser) to another (the 

number ot configurations tor n coins distributed among g 



3 Methods of solution 



3.1 An irreducible Markov chain 



The dynamic mechanism of the BDY game is the hop- 



winner). The natural description is in terms of agents, 
Y = (ni, . . . , 7i s ). Let us suppose that at given time, t, the 



agents is g n . This can be called the coin description. 

The second (and most important in the present case) 

„ .. , agents are described by the state Y(t) = (ni, . . . ,n a ) := 

description is in terms ot com occupation numbers, Y = 

, , N , , . , , , n. At the next step, the possible values of Y(t + 1) are: 

[Yi, . . . , Y g ), where the random variable Yj denotes the 



Y(t + 1) = (fix, ..,rii - 1, ...,nj + 1, ..,n g ) := nj, corre- 
sponding to the a loss of the ith— agent and a win of the 
jth— one. The transition probability between these states 



is: 



number of coins (the wealth) of the jth— agent. If the set 
of configurations, X, is known, then Yj|X = # {Xi : Xi = 
j,i = 1, ...,n}, that is the value of Yj conditioned on X is 
the number, rij, of all Xi equal to j. Then, one can de- 

F(rr?'ln) = 1 ~ 1 ~ ^ , -| , 

fine Y = n := (rii, . . . , n g ) as the set of occupation num- * g — zo(n) g — 1 

bers; they satisfy the constraint J2i n i ~ n - This can be where the first term, (1— 5 ni fi)/{g— zo(n)) = (l—S ni fi)/k(ri), 

called the agent description. It tells us the number of coins describes the random choice of the loser among the agents 

(wealth) of each agent. The total number of distinct agent with at least one coin (n^ > 0), and the second term, 

(n + g — l\ 

descriptions for g agents sharing n coins is I ] . (1 — <5i.j)/(g — 1), is the probability that the jth— agent 



The less complete description is in terms of coin oc- is the winner. As also an agent with zero coins can be 
cupancy numbers or partitions: Z = (Zq . . .Z n ), where a winner, there are no absorbing states. Note that in eq. 
Z/JY = = h, j — 1, ...,<?}, that is the number Q the assumption is made that coins necessarily change 
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agent; if one admits that coins can come back to the 
loser, the second term simplifies to 1/g, the dynamics 
slightly changes, but the equilibrium distribution is not af- 
fected. Considering both the intuitive meaning of the game 
and the formal transition probability Q), the sequence 
Y(O), Y(l), Y(i) is a discrete-space and discrete-time 
Markov process, i.e. a finite Markov chain; every state can 
be reached from any other state, the set of states is irre- 
ducible, and no periodicity is present. Hence, there exists 
an invariant probability distribution, and this distribu- 
tion coincides with the equilibrium one. This means that 
lim f _ >00 P(Y(t) = n|Y(0) = n') = 7r(n), independently 

from the initial state Y(0) = n'. Moreover, 7r(n) >0 holds 
f n + g — l\ 

for all the ( possible occupation numbers. 

n J 



following 10 x 10 transition matrix 



3.2 Direct enumeration and Monte Carlo sampling 

The direct enumeration method can be used to study the 
game when g and n are not too large. To illustrate the 
method, let us consider the case g = n = 3. The total num- 
ber of agent descriptions is 10: (0,0,3); (0,3,0); (3,0,0); 
(0,1,2); (1,0,2); (1,2,0); (0,2,1); (2,0,1); (2,1,0); (1,1,1). 
The transition matrix between these states can be directly 
computed by using the rules of the game. For instance, 
the state (0, 0, 3) can only go into the two states (0, 1, 2) 
and (1, 0, 2) with equal probability 1/2. The state (0, 1, 2) 
can go into the four states (1, 0, 2), (0, 2, 1), (1, 1, 1), and 
(0, 0, 3) and each final state can be reached with probabil- 
ity 1/4. These considerations lead to the definition of the 



\ 



1/2 1/2 
1/2 1/2 
1/2 1/2 
1/6 1/6 1/6 1/6 1/6 1/6 
1/4 1/4 1/4 1/4 
1/4 1/4 1/4 1/4 
1/4 1/4 1/4 1/4 
1/4 1/4 1/4 1/4 
1/4 1/4 1/4 1/4 
\ 1/4 1/4 1/4 1/4 J 
The vector, w, giving the equilibrium probability distribu- 
tion can be computed diagonalizing P, as its transpose, 
7r* , satisfies: 7r*P = tt*. In particular, in this case, one 
gets: tt(0, 0, 3) = tt(0, 3, 0) = tt(3, 0, 0) = 1/18, vr(l, 1, 1) = 
1/6, and tt(0, 1,2) = tt(1,0,2) = tt(1,2,0) = tt(0,2,1) = 
tt(2,0,1) = 7r(2, 1,0) = 1/9. A Monte Carlo simulation 
of the game can help in the case of larger systems. The 
simulation can sample both the transition matrix and the 
equilibrium distribution. Both methods, direct enumera- 
tion and Monte Carlo sampling, are limited by the size 
of the state space. However, for the BDY game a general 
exact solution can be derived. 

3.3 Exact solution 

As the size of the state space is a rapidly growing function 
of n and g, the invariant distribution can be investigated 
via the detailed balance equation [8]. 

Let us consider two consecutive states: (rii, 
rij , ..,n g ) and (n\, .., rii — 1, rij + 1, .., n g ) , with the con- 
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ditions n, > and i ^ j . The direct flux is given by reader is invited to verify this property in the particular 

^ ^ case g — n = 3 described in the previous subsection. 

7r(n)P(nf|n) = 7r(n) - — ; 

9 z o{ ) g ^he hypothesis of equal a priori probabilities for all 

the inverse flux is the agent descriptions seems at the basis of Bennati's and 

^ ^ Dragulescu and Yakovenko's analysis of the game, whose 

7r(n^)P(nK) =ir(n{) _ 

9 zq (n.^ j g conclusions are not fully correct if one considers eq. © • 

The two fluxes are equal if This hypothesis on occupation numbers can already be 



n n ): — —fz\z — 7 = ^K)- 



found in a paper by Boltzmann published in 1868 and 



g z (n) g 1 g _ z (n^) g 1 leading to the so-called Bose-Einstein statistics PlOllll| . 

that is if 7r ( n ) g _ z | ) ( n ) = C ; where C is a constant. Indeed, if 7r(n) were uniform in eq. Q, one would get the 

Hence the probability function: most probable value of Zi by maximizing the multinomial 

prefactor subject to the constraints for Z. In the limit of 
P(Y = n)=7r(n)=Cfc(n)=C(<7-2 (n)) (2) ' 1 

large systems, the result is z* = —e i . At the end of 

a 

is invariant, and it coincides with the equilibrium one. the next subsection, the limit n >> g >> 1 will be con- 
Two remarks are useful. First of all, in eq. J2J 7r(n) sidered for the BDY game, where the exponential wealth 
does not depend on the agent labels but is a function of the distribution is recovered as an approximation to the exact 
partition Z(n) to which the description Y = n belongs, solution. 

This implies that all the sequences Y = n' and Y = n are The normalization constant C is computed in the Ap- 
equiprobable, if n' and n belong to the same Z, that is if pendix, based on the method described in a paper by Hill 
n' is any permutation of n. Therefore, the random vari- (T5|. It turns out that: 
ables (Yi, . . . ,Y g ) are exchangeable and they are also 1 

,k - 1 



equidistributed, once equilibrium has been reached and eq. Sfe=i ^ {j\ 

(J2J holds. All n belonging to the same Z being equiprob- Eqs. ©, ©, together with the normalization Q, give 



able, one gets for the partition probability distribution: the equilibrium distributions for the BDY game. 

J7(z) = I ! 7r(n)=C t r (ff - Zo(n)) (3) 3.4 The average wealth distribution 

Ho Zi - 110 Zi - 

Secondly, only those agent descriptions sharing the The number of the agent descriptions, n, and of the par- 
same number of agents without coins have the same prob- titions, Z, is very large for g and n large. Moreover, both 
ability. Indeed, the probability of a given occupation vec- 7r(n) and n(z) are multidimensional distributions. In or- 
tor n depends on Zo(n), and, thus, it is not uniform. The der to search for a quantity that can compared with ex- 
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E(z \k)=g-k 

n — i — 1 



E(^\k :■ I) = /■• v J?—L ' ■.) = I „ ;{>; 



perimental observations, one can notice that agents are k. Conditioned on k, one gets 
exchangeable and any probability distribution is symmet- 
ric with respect to the exchange of their labels. Empirical 
data are given in terms of the actual wealth distribution 
z. At any step, Z(t) = z(t) is just the actual wealth dis- 
tribution. If equilibrium is reached, 7T(z) represents the 
multivariate sampling distribution, and the vector E(z) 

denotes the set of first moments of il(z). It is useful to P(k) = Ck( ^\ ( U ~ ^ 

define the marginal average 



k-l / 

E(z l \k = 1) = Si. n ,i = 1, . 
and the equilibrium probability of k is 



Finally, using eqs. (@J, © and Q, one gets 
E{zi) = £ *n{m). (5) E ^ = E E ^\ k ) P ^ * = 0, 1, .... n (8) 



Z continuously fluctuates around E(z). As a conse- 
quence of the ergodic thorem for Markov chains, one has 
that lim^oo ^°=i z *( 3 ) = E{zj), and this convergence is in 
probability. Hence, if the empirical or simulated sequence, 

z(0), z(l), z(t), is available, the comparison is passi- 
ve z(s) 

ble between the time average \ and the ensem- 
ble average E(zi) predicted from the knowledge of n(z). 
E(zi), the average wealth distribution, will coincide with 
the most probable value of Z (say z*) for large systems. 
As already noticed, if 7r(n) were uniform, then one could 
find the most probable value of Z, z*, by using Lagrange 
multipliers, and the functional form of z* would be expo- 
nential in the Stirling approximation. 



k=l 

The proof of the above results can be found in the Ap- 
pendix. Notice that the thermodynamic limit (n,g,k » 

1) of eq. ® is ~ - (l - -V. Then, the av- 

k n \ n J 

erage fraction of agents with at least one coin follows a 
geometric distribution that becomes exponential in the 
continuous limit. In this limit, the average wealth distri- 
bution, E(zi), (or the most probable wealth distribution 
z*) is a mixture of exponential distributions with mixing 
measure given by eq. J7J). 

Considering eq. J7J, one observes that 

P(k + 1) _ (,g-fc)(n-fc) 
P{k) ~ P 

with > 1 for k < k* = -22-, and < 1 

for k > k* . Therefore, in the case of minimum density, 
n = g, one has that P{k) is bell-shaped with flat maximum 



In the BDY game, this is not the case. However, as at k* — and k* + 1, as P p fc ^ 1 - ) = I, k* — |. In 

a consequence of eq. (01, 7r(n) is uniform for all vectors the large density limit n >> g, the curve is left-skewed, 

with the same k = g — zq. The exact value of E(zi) can be the maximum is very close to g, as k* — 1+ 9 g / n — 5(1 — 

derived analyzing all the agent descriptions with the same g/n). Furthermore, if g(l — g/n) > g — 1, i.e. g 2 < n, the 
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maximum value is just k* — g. In the case of large density, 
the mixing probability distribution is concentrated on a 
small number of values of k, and, thus, if g » 1 the 
behaviour is not very different from the single geometric 



distribution 



E(z i+ i\g) _ g f g 



(!-£)' 
n V n/ 



that becomes the 



exponential — e * , \ — —• This remark explains why large 

X 9 

scale simulations of the BDY game with n >> g appear 
compatible with an exponential wealth distribution. 

3.5 Comparison with Monte Carlo simulations 

In this section, the results of Monte Carlo simulations are 
compared with the exact equilibrium wealth distribution. 
The simulations have been performed on a standard desk- 
top computer equipped with a 1GHz processor. In the 
initial state all the agents are given the same amount of 
coins. After an equilibration run of 1000 MC steps, the 
values of Zi have been sampled and averaged over 10 5 MC 
steps. In the cases reported in Figs. 1-3, the execution time 
is a few seconds. 

It is interesting to remark that for small values of g 
the distribution is strongly dependent on g: it is uniform 
for g = 2, linear for g = 3, parabolic for for g = 4,. . .. 
Except for the very peculiar case g = 2, the distribution 
is decreasing for i > 1, but in some cases E(z ) < E{z\). 
The latter feature deserves further investigations. Fig.l 
shows the case g = 3 and n = 3, whereas Fig. 2 has again 3 
agents, but 30 coins. Fig. 3 is the logarithmic graph for g = 
30 and n = 30 to illustrate the approach to an exponential- 
type distribution for large values of the number of agents, 
9- 
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Fig. 1. Theoretical (cross) and simulated (circle) points for 
g = 3, n — 3, after 10 5 simulation steps. 
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Fig. 2. Theoretical (cross) and simulated (circle) points for 
g = 3, n — 30, after 10 simulation steps. 
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Fig. 3. Theoretical (cross) and simulated (circle) points for 
g — 30, n = 30, after 10 5 simulation steps. The simulation is 
too short to reproduce the smaller values of E(zi) for i > 15. 
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4 Discussion and conclusions One of the main results of this paper is eq. ©, giving 

the so-called wealth distribution. As the agent descriptions 
Recently, parsimonious exchange games like the one stud- are not equiprobable, previous statistical mechanical ar- 
icd in this paper have been challenged by a group of lead- Stents have to be revised. In general, the wealth distri- 
ing non-orthodox economists pilH) . These games have bution is not exponential and it becomes exponential only 
been introduced in order to explain the allocation of wealth in the appropriate limit of large density and large number 
in the presence of finite resources. In pHTl| . they are 01 a S ents - lt is interesting to study the rate of approach 
considered unrealistic because they do not take into ac- to equilibrium in the BDY model, but this will the sub- 
count the free will of agents to participate in an exchange, J ect of a future P a P er of this series - The next P a P er of the 
and they include only strictly conserved resources, with- series ' wil1 be devoted to a sct of sim P le exchange models 
out production. Incidentally, in games such as the OPIP or for the redistribution of wealth that can be regarded as 
the BDY models, inequality is obtained by pure chance. to y taxation mechanisms. 
Rich agents have no specific individual merit. Based on 
their beliefs, some scholars could also dislike this feature. APPENDIX 

Replies to the objections in |18U14j have already ap- 
peared in two papers by Angle and by McCauley 
In particular, Angle presents various arguments in favour 
of parsimonious exchange games, including their ability to 

reproduce empirical facts ^7]. W(g,n) 

The present authors would also like to stress that, also 
thanks to simple exchange models, a new concept of equi- 
librium could find its way into Economics: namely Sta- 
tistical equilibrium. Many stochastic models in Economics 
are Markov chains or Markov processes (see refs. [1811191 
|2*U] for recent examples) and the concepts developed in 

/n-fe + fc-l\_/n-l\_/n-l 
this paper apply to those cases. These ideas will be the I n — k J ~~ \n — k) ~ \k — 1 

subject of future papers on the role of statistical equilib- 
rium in Economics. The reader can consult ref. |21j for 
an early discussion and refs. [16,22 for a criticism on the 

relevance of thermodynamic equilibrium in Economics. W(k, g,n) — \f ; J\ n _j { 



The normalization constant 



The total number of possible agent descriptions, n, is 



n + g — 1 

n 



and they can be classified in terms of the number of agents 
with at least one coin: k = g — zq, k = 1, ...,<?. Therefore, 
the number of agent descriptions with k fixed agents with 
at least one coin is given by all occupation numbers which 
allocate n — k coins to k agents, that is 



while [ ' ] are the different ways to choose the k agents 
. k j 



among the g available. Then 



9\ fn-1 
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is the number of agent descriptions with k agents with at 
least one coin. Indeed, one has: 



71 + 5-1 

n 



E 

fe=i 



g\ (n - 1 



k I \n — k 



and this formula expresses the decomposition of all possi- 
ble states in terms of their "support" k. The decomposi- 
tion can be re-written as: 



W(g,n) = Y,W(k,g,n). 



k=l 



Turning to eq.©, the sum on all states can be divided 
into a sum over k and a sum over n|fc, that is: 

a 

i = J2 < n ) = c E k ^ = c E kW ^ ^ n ) = 



fc=i 



k=l 



g\(n-\ 



k) \n — k I ' 



which gives the desired normalization constant. 

Derivation of equation (O 

The average number of agents whose occupation num- 
ber is equal to i is 

a 

E{z l ) = Y, p{ yi = i )=v p ^ = i )- 

3 = 1 

the last equality holding as the Y's are equidistributed. 
P(Yj = i), i = 0, 1, n is the marginal equilibrium prob- 
ability of the wealth of the jth— agent, and it is the same 
for all j's. It is necessary to study the marginal distribu- 
tion of an agent associated to the agent description proba- 
bility © and to the partition probability © , both holding 
at equilibrium. In order to derive formula @, one needs 

E(zi\k) = gP(Yj =i\k): 



the marginal wealth distribution of an agent conditioned 
to k — g — Zq. One knows from J3J that all agent descrip- 
tions Y = n := (Y~i = m, Y g — n g ) with the same k are 
equiprobable, and their number is 



W(k,g,n) = 



g\ fn-l 

- k 



g\/n-l 
k)\k-l 



Then P{Y\ = ni\k) := P(Y = i\k) is equal to the number 
of Y's such that g — 1 agents share n — i coins divided 
by W{k,g,n). The calculation can be divided into three 
parts. First, let us consider P(Y = 0|fe); one has: 



P(Y = 0\k) = 



'g - 1\ fn - 1 
W(k,g-l,n) { k iU-1 
W(k,g,n) 



g\/n-l 
k)\k-l 

9-1) 

k J _ (5-1)! (g-k)l g-k 



(g-l-k)\ g\ 



9 



then, let us consider P(Y = i\k) with k > 2, and i > 0; as 
there are k — 1 agents left with at least one coin, one has: 

W(k-l,g-l,n-i) _ 



g — 1\ fn — i — 1\ fn — i — 1 N 
k - 1 J { k-2 J k[ k-2 



k \n~k U-l, 



(9) 



finally, for k = 1, one gets: P(Y = i\k = 1) = ^y 1 , for 
i > 0, as in this case all coins are concentrated on a single 
agent. Eventually, by determining E[zi\k), one obtains eq. 
© as required. 
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